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ABSTRACT 



This study investigated the performance of Alabama College 
System (ACS) students on a Basic Skills Test (BST) and compared it with 
non-ACS students' scores to determine whether there were significant 
differences in achievement. The Alabama Basic Skills Test is required of all 
students seeking admission to teacher education programs at Alabama colleges 
or universities. This study included 1,181 ACS students and 1,518 non-ACS 
students. A comparison of the mean scale score for students who had attended 
an ACS institution (353.92) and those who had not (351.86) revealed that 
there was no statistical difference between the mean scale scores for the two 
groups. However, the percentage of ACS students passing the BST (93%) is 
statistically significantly higher than students who have not attended an ACS 
institution (89%) . A comparison of scores by race and gender indicate 
differences in mean scores by race but no difference between males and 
females . The relationship between age of student and BST scale score was 
investigated and showed that there was no significant relationship. These 
data suggest that the core preparation provided by the institutions of The 
Alabama College System for students intending to become teachers in Alabama 
public schools is comparable to the preparation received at other 
institutions. (JA) 
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EXECUTIVE SUMMARY 



The Performance of Alabama College System Students on 
the Alabama Basic Skills Test 

The Alabama College System seeks to provide accessible quality educational opportunities, promote economic 
growth, and enhance the quality of life for the people of Alabama. One indicator of whether the Alabama College 
System (ACS) is providing quality educational opportunities would be to compare performance on an academic 
achievement test between ACS students and students who did not attend an ACS institution. The Alabama Basic 
Skills Test (BST) is a criterion-referenced test, developed by National Computer Systems, designed to measure a 
student’s skills in relation to an established level of performance rather than to other students who have taken the 
test. The Alabama State Board of Education established a minimum passing score for admission to teacher 
education programs of 300. 

This study investigated the performance of ACS students compared with non- ACS students to determine whether 
there were significant differences in achievement. The study included 1,181 ACS students and 1,518 non- ACS 
students. A comparison of the mean scale score for students who had attended an ACS institution (353.92) 
and those who had not (351.86) revealed that there was no statistical difference between the mean scale 
scores for the two groups. However, the percentage of ACS students passing the BST (93.2%) is 
statistically significantly higher than students who have not attended an ACS institution (89.0%). 

A comparison of scores by race and gender indicate differences in mean scores by race but no difference between 
males and females. The relationship between age of student and BST scale score was investigated and showed 
that there was no significant relationship. 

An examination of the records of 209 students who attended an ACS institution only during the summer term (not 
considered an ACS student for these analyses) indicated that the majority of these students were taking regular 
courses and not remedial courses. While it can not be stated with certainty, the data suggest that students who are 
enrolled in 4-year institutions may be taking classes during the summer at ACS institutions and then transferring 
these credits back to their home college/university. The courses for which students enrolled during summers 
include Principles of Macroeconomics, Principles of Micro-economics, Applied Differential Equations, American 
Literature I & II, and World Literature. From this partial listing, it is clear that the students are not returning to 
ACS institutions to acquire the basics but rather to continue their educational programs. 

In summary, the data suggest that the core preparation provided by the institutions of The Alabama College 
System for students intending to become teachers in Alabama public schools is comparable to the preparation 
received at other institutions. Alabama College System transfer students perform no differently in terms of 
average scores than other students on the Alabama Basic Skills Test, but the percentage passing is higher. 
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The Performance of Alabama College System Students on 
the Alabama Basic Skills Test 



Background 



The Alabama Basic Skills Test is a criterion-referenced test developed by National Computer Systems. The test 
is designed to measure a student’s skills in relation to an established level of performance rather than to other 
students who have taken the test. This test has been used since 1992 and is required for all students seeking 
admission to teacher education programs at Alabama colleges or universities. 

The test consists of three major content areas; reading, writing, and mathematics. The reading portion requires 
students to use context clues and structural analysis to determine the meaning of unfamiliar words. Students must 
read short passages and identify, interpret, and evaluate various components of the passage. Familiarity with the 
scope of commonly used reference materials- for example, the dictionary, library card catalog, charts and graphs-is 
also assessed. 

Writing ability is tested with a series of multiple-choice questions and through an essay in response to a given 
topic. The mathematics area assesses basic knowledge of arithmetic, geometry, statistics, and measurement. It is 
reported by NCS that most questions in the mathematics section require students to demonstrate problem-solving 
ability, as well as knowledge of mathematical procedures. 

The test is composed of the essay and 100 multiple-choice items. Scores for the Alabama Basic Skills Test are 
reported on a scale from 94 to 428. A score of 428 represents the maximum score possible. A score of 94 
represents the lowest score reported. The Alabama State Board of Education established a minimum passing 
score for admission to teacher education programs of 300. The final score is determined by combining the essay 
score with the multiple choice score. 

The test is administered on a Saturday in January, April, July and October of each year. The registration fee for 
examinees is $50. 

During the period November 1992 to April 1999, the Alabama State Department of Education reported that 
30,61 1 students sat for the Alabama Basic Skills Test. The Alabama State Department of Education analyses of 
these data are reported in Table 1. 

Table 1: Alabama Basic Skills Test* 



Number 

Tested 


Mean Scale 
Score 


Standard 

Deviation 


Minimum 

Score 


Maximum 

Score 


Percent 

Passing 


30,611 


353.8 


39.0 


178 


428 


89.5% 



* Data provided by the Alabama State Department of Education 
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Research Question 

This research was conducted to determine if there was a significant performance difference on the Alabama Basic 
Skills Test between students who have attended an Alabama College System 2-year institution prior to 
transferring to a 4-year institution and students who enroll directly in an Alabama 4-year college or university 
(referred to as ‘native students’) or attended other institutions prior to sitting for the Alabama Basic Skills Test. 
In addition to this question, an investigation of performance by age, race and gender was undertaken to determine 
if there were differences in performance based on these demographic factors. 

Sample 

The Alabama State Department of Education provided a database containing 2,699 records. There were data 
from three test administrations in October 1999, January 2000, and July 2000. The data from the April 2000 
administration were not provided. The number of records for each administration is presented in Table 2. 

Table 2: Number of Examinees by Test Date 



October 1999 


January 2000 j 


•duly 2000 s§i 


905 


991 


803 



To determine if the data for the three administrations were consistent with the historical data provided by the 
Alabama State Department of Education, basic descriptive statistics were calculated. These data are provided 
in Table 3. 

Table 3: Comparison of Sample Statistics to Historical Data 





W TfcT 

Number 

Tested 

¥ 


Mean Scale 
Score 


*' Standard 
Deviation 

i|f W' ' i 


f Minimum 
Score 

f r 


Maximum 

Score 


Percent 

Passing 


Historical 


30,611 


353.80 


39.00 


178 


428 


89.5% 


Sample 


2,699 


352.76 


36.39 


221 


424 


90.8% 



An inspection of Table 3 indicates that the data for the three administrations do not appear to be meaningfully 
different from the data calculated from 1992 to 1999. It is interesting to note, however, that the minimum score 
has increased by 43 scale score points in these administrations and there was a concomitant increase in the 
passing percentage. Based on these data, further analyses were undertaken with the assumption that the results of 
such analyses would be generalizable to the longitudinal population of students who have taken the test. 
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Methodology 

The initial database of 2,699 students provided by the Alabama State Department of Education was compared 
with files from the Alabama State Department of Postsecondary Education to determine which students attended 
an Alabama College System (ACS) institution prior to sitting for the Alabama Basic Skills Test. Student 
attendance at an ACS institution was defined as registering for classes for more than one quarter/semester (in 
1999 the ACS institutions changed from the quarter system to the semester system) excluding summers between 
fall 1995 and fall 1999. In other words, if a student only attended an Alabama College System institution during 
summers, that student was not considered as attending an ACS institution. There were 209 students who were 
excluded because of summer-only attendance. These students and the courses they took during the summer terms 
will be discussed later in this report. 

Using the selection conditions specified above, it was determined that 1,181 students who took the Alabama 
Basic Skills Test had attended an Alabama College System institution since 1995. It was then assumed that the 
remaining 1,518 students (including those who attended summers only) would be considered students native to 
the 4-year institution. It is recognized that some of these students may have attended a 2-year institution in 
another state or that some of the students may have transferred from another 4-year institution; however, given 
the research question under investigation, these possibilities do not impact the analyses conducted herein. 

The following data were provided for all students: age, gender, ethnicity, academic standing, and BST scale score. 
These data were used for all analyses conducted. 

The mean scores for various comparisons were used to determine if significant differences existed between 
various groups. Where appropriate, statistical tests were conducted; however, since statistical significance is 
directly related to sample size and the sample size here is large, effect sizes were also calculated. The effect size 
indicates whether the differences observed are meaningful in terms of the measures under investigation and is 
required for all articles submitted to certain journals for publication (e.g., Research in Schools, Journal of 
Experimental Education). The effect size is an indication of the magnitude of difference between the groups 
expressed as a locator on the distribution of the control variable. 

Results 

A comparison of the mean scale score for students who had attended an ACS institution and those who had 
not revealed that there was no statistical difference ( t-1.462 ; df= 2697; p = .144) between the mean scale 
scores for the two groups. The number tested and the average scale score by ACS institution is included as 
Appendix B. The descriptive statistics for each group are presented in Table 4. 
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Table 4: Mean Scale Scores for ACS and Non- ACS Students 





; -iP ,imbe ii r| 

1 Tested 


Mean Scale 4 
"Score 


^Standard 

Deviation 


Minimum^ 

Score 


IMaximum 
f Score 


Percent 

Passing 


ACS Students 


1181 


353.92 


33.06 


221 


423 


93.2% 


Non-ACS Students 


1518 


351.86 


38.74 


228 


424 


89.0% 



From Table 4 it can be seen that the mean scale scores are virtually the same but the interesting finding is the 
passing percentage for each group. The percentage of ACS students passing the BST is statistically significantly 
higher than students who have not attended an ACS institution (z = 3.74; p < .001). A comparison of the 
distribution of scale scores shows that both distributions are very similar in terms of skewness and variance. 
Histograms for each group are presented as Figure 1 and Figure 2. 

Figure 1: Distribution of Scale Scores for ACS Students 



160 




BST Scalescore 



Page 6 




7 



THE ALABAMA 
COLLEGE SYSTEM 

Ctnnitj 9 Jniir 9 Tetliltal 9 tipper liriiin 



Report 00-01 1 



Figure 2: Distribution of Scale Scores for Non- ACS Students 
200 T 




BST Scalescore 

A comparison of scores by race and gender indicate differences in mean scores by race but no difference between 
males and females. 

There was a statistically significant difference between African American students and Caucasian students on the 
mean scale scores on the BST (t=30.77; df = 2594; p<.00 1). Table 6 shows the means and the effect size for this 
difference. 

Table 5: Mean Scale Scores for African American and Caucasian Students 



Ethnicity 


Number 


Mean Scale Score 

* « 


Standard 

Deviation 


Effect Size 

vft 


Caucasian 


1890 


364.78 


29.10 


1.19 


African American 


706 


322.90 


35.11 





From Table 5 it can be seen that the mean score for Caucasian students is 1 . 1 9 standard deviations higher than the 
mean for African American students. This difference is meaningful and indicates a real difference in performance 
between these groups of students. 
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The investigation of differences between males and females indicated no significant difference in mean BST scale 
scores (t= .858; df = 2697; p = .391). Table 6 provides the descriptive data for these variables. 



Table 6: Mean Scale Scores for Males and Females 



Gender 

• Ok-* 


■ 


Number 

.*& . >-4k' 


Mean Scale Score 

: - ' f m 

1 ii' 


Standard 
j, Deviation 


Effect Size 


Male 


612 


353.87 


35.16 


.04 


Female 


2087 


352.44 


36.78 


# 4 



Appendix A provides the mean scores by gender and ethnicity for ACS and non- ACS students. 

The relationship between age of student and BST scale score was investigated and showed that there was no 
significant relationship (r = -.03 1 ; n = 2699; p = . 1 03). When student age was placed into categories, a trend was 
observed but the differences are not significant. Figure 3 shows the mean BST Scale Score by various age 
categories. 

Figure 3: Mean BST Scale Scores by Age Category 

3701 




18-19 20-21 22-24 25-29 30-34 35-39 40-49 50-64 



CATEGORY 



Page 8 



O 



9 



THE ALABAMA 
COLLEGE SYSTEM 

Ciimitj 9 Juitr 9 Teckiicil 9 Upper HtIiIii 



Report 00-01 1 



Discussion/Conclusions 



From the analysis conducted it is clear that there is no difference in the performance on the Alabama Basic Skills 
Test between students who have attended an Alabama College System institution and those students who did not 
attend an ACS institution. There were no significant differences in the mean scale scores among various age 
groups of students nor between males and females. Significant differences were observed between African 
American students and Caucasian students. These differences were observed for the entire sample, and for both 
comparison groups. 

An examination of the records of the 209 students who attended an ACS institution only during the summer term 
indicated that the majority of these students were taking regular courses and not remedial courses. These students 
do not appear to be those who had not passed the BST and were coming to an ACS institution as a method of 
improving test score performance. While it can not be stated with certainty, the data suggest that students who 
are enrolled in 4-year institutions may be taking classes during the summer at ACS institutions and then 
transferring these credits back to their home college/university. The courses for which students enrolled during 
summers include Principles of Macroeconomics, Principles of Micro-economics, Applied Differential Equations, 
American Literature I & II, and World Literature. From this partial listing, it is clear that these students are not 
returning to ACS institutions to acquire the basics but rather to continue their educational programs. 

Finally, the data suggest that the core preparation provided by the institutions of The Alabama College System for 
students intending to become teachers in Alabama public schools is comparable to the preparation received at 
other institutions. Alabama College System transfer students perform no differently in terms of average scores 
than other students on the Alabama Basic Skills Test, but the percentage passing is higher. 
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APPENDIX A 





Gender 


Ethnicity 


Mean 


N 


Standard 






J*: JSS£,„:> 




- A: 


, ^Deviation 


ACS Student 


Female 


Asian 


346.57 


7 


33.67 




Black 


326.01 


147 


32.54 




iHispanigg .. 


309.67 


6 


45.40 




Am Indian 


366.80 


20 


34.83 




Other 


332.33 


3 


48.91 




fc:; ^ 

White; f r-. ^ 


359.15 


738 


30.10 




ffotal 


353.47 


924 


33.33 




Male 


Asian 


367.00 


1 






fBlackf 1 -?'- ' 1 


323.43 


23 


38.92 




Am Indian 


364.50 


2 


14.85 




.Other , 


267.00 


1 






f White%# 


359.19 


229 


29.17 




Total 


355.56 


257 


32.09 




Totals 


i Asian 


349.13 


8 


32.00 




£ sm t ',/• - 

Black 


325.66 


170 


33.36 




Hispanic 


309.67 


6 


45.40 




Am Indian 


366.59 


22 


33.29 




Other 


316.00 


4 


51.59 




White 


359.16 


967 


29.87 




Kota/ % j 


353.92 


1181 


33.06 


Non-ACS Student 


Female 


Asian 


348.33 


6 


28.98 




Black 


320.60 


401 


35.90 




Hispanic 


358.33 


6 


44.39 




Am Indian 


338.44 


9 


45.58 




° ther .* 4 


323.45 


20 


26.78 




White ? 


370.49 


715 


27.44 




Total 


351.62 


1163 


39.21 




Male, 


Black,, j < * 


326.28 


135 


34.60 




Hispanic 


312.00 


3 


35.76 




Am Indian 


375.00 


2 


26.87 




Other | ‘ $ 


326.50 


4 


54.73 




White 


371.24 


208 


25.75 




Total 


352.65 


355 


37.22 




Total 


Asian 


348.33 


6 


28.98 




Black 


322.03 


536 


35.63 




Hispanic 

* *$ 


342.89 


9 


45.69 




Am Indian 


345.09 


11 


44.19 




Other 


323.96 


24 


31.38 




White 


370.66 


923 


27.06 




Total 


351.86 


1518 


38.74 
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APPENDIX A 
(Continued) 



Total 


Female 


Asian 


347.38 


13 


30.29 




iBlack - 


322.05 


548 


35.08 




Hispanic 


334.00 


12 


49.78 




Am Indian 


358.00 


29 


39.93 




Other 


324.61 


23 


29.09 






364.73 


1453 


29.36 




Total 


352.44 


2087 


36.73 


j Malei*. f , s 


Asian 4 


367.00 


1 






Black 


325.87 


158 


35.15 




Hispanic ^ . 1 


312.00 


3 


35.76 




Am Indian 


369.75 


4 


18.73 




Other Jk- i 


314.60 


5 


54.36 




White 


364.92 


437 


28.22 




fTotal A Jt 


353.87 


612 


35.16 




Total 


A . # W 

Asian 


348.79 


14 


29.57 




|Black 


322.90 


706 


35.11 




Hispanic 


329.60 


15 


47.04 




Am Indian 


359.42 


33 


37.99 




Other 


322.82 


28 


33.80 




‘ White L 


364.78 


1890 


29.10 




Totaf 


352.76 


2699 


36.38 
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APPENDIX B 



BASIC SKILLS TEST 
AVERAGE SCALE SCORE 
BY ACS INSTITUTION 



Institution 


Number Tested 


Average Scale Score 


Northeast Alabama Community College 


49 




366.06 


Snead State Community College 


51 




364.86 


Calhoun Community College 


131 




364.38 


Jefferson State Community College 


61 




362.36 


Southern Union State Community College 


70 




358.53 


Wallace State Community College (Hanceville) 


103 




357.74 


Shelton State Community College 


59 




357.31 


Alabama Southern Community College 


25 




357.08 


North we st- Shoals Community College 


76 




355.87 


Central Alabama Community College 


37 




355.84 


Alabama College System Average ^ ^ ^ | 


4 1,181 

«*, m&P 


•4 • w 


,i 353 92 


Lurleen B. Wallace Junior College 


36 




353.83 


Bevill State Community College 


65 




353.74 


Gadsden State Community College 


109 




353.48 


Non-ACS Institutional Average 


^ • ' 1,518 


f 


“^151186 


Enterprise State Junior College 


27 




351.41 


Wallace Community College (Dothan) 


47 




349.15 


Faulkner State Community College 


71 




345.56 


Bishop State Community College 


45 




338.56 


Ayers State Technical College 


1 




338.00 


Wallace State Community College (Selma) 


26 




337.96 


Chattahoochee Valley Community College 


46 




336.50 


Jefferson Davis Community College 


11 




334.18 


Northwest-Shoals Community College (Phil Campbell) 


11 




328.36 


Lawson State Community College 


16 




324.06 


Trenholm State Technical College 


1 




321.00 


Patterson State Technical College 


1 




311.00 


Reid State Technical College 


4 




301.25 


MacArthur State Technical College 


2 




295.50 



Data from SDE files on BST Administrations in Oct 1999, Jan 2000, and July 2000 
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